patient experience
Patients Speak, AI Listens: LLM-based Analysis of Online Reviews Uncovers Key Drivers for Urgent Care Satisfaction
Xu, Xiaoran, Xue, Zhaoqian, Zhang, Chi, Medri, Jhonatan, Xiong, Junjie, Zhou, Jiayan, Jin, Jin, Zhang, Yongfeng, Ma, Siyuan, Li, Lingyao
Investigating the public experience of urgent care facilities is essential for promoting community healthcare development. Traditional survey methods often fall short due to limited scope, time, and spatial coverage. Crowdsourcing through online reviews or social media offers a valuable approach to gaining such insights. With recent advancements in large language models (LLMs), extracting nuanced perceptions from reviews has become feasible. This study collects Google Maps reviews across the DMV and Florida areas and conducts prompt engineering with the GPT model to analyze the aspect-based sentiment of urgent care. We first analyze the geospatial patterns of various aspects, including interpersonal factors, operational efficiency, technical quality, finances, and facilities. Next, we determine Census Block Group(CBG)-level characteristics underpinning differences in public perception, including population density, median income, GINI Index, rent-to-income ratio, household below poverty rate, no insurance rate, and unemployment rate. Our results show that interpersonal factors and operational efficiency emerge as the strongest determinants of patient satisfaction in urgent care, while technical quality, finances, and facilities show no significant independent effects when adjusted for in multivariate models. Among socioeconomic and demographic factors, only population density demonstrates a significant but modest association with patient ratings, while the remaining factors exhibit no significant correlations. Overall, this study highlights the potential of crowdsourcing to uncover the key factors that matter to residents and provide valuable insights for stakeholders to improve public satisfaction with urgent care.
- North America > United States > Florida > Hillsborough County > Tampa (0.14)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > Virginia (0.04)
- (10 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
Conversational Medical AI: Ready for Practice
Lizée, Antoine, Beaucoté, Pierre-Auguste, Whitbeck, James, Doumeingts, Marion, Beaugnon, Anaël, Feldhaus, Isabelle
The shortage of doctors is creating a critical squeeze in access to medical expertise. While conversational Artificial Intelligence (AI) holds promise in addressing this problem, its safe deployment in patient-facing roles remains largely unexplored in real-world medical settings. We present the first large-scale evaluation of a physician-supervised LLM-based conversational agent in a real-world medical setting. Our agent, Mo, was integrated into an existing medical advice chat service. Over a three-week period, we conducted a randomized controlled experiment with 926 cases to evaluate patient experience and satisfaction. Among these, Mo handled 298 complete patient interactions, for which we report physician-assessed measures of safety and medical accuracy. Patients reported higher clarity of information (3.73 vs 3.62 out of 4, p < 0.05) and overall satisfaction (4.58 vs 4.42 out of 5, p < 0.05) with AI-assisted conversations compared to standard care, while showing equivalent levels of trust and perceived empathy. The high opt-in rate (81% among respondents) exceeded previous benchmarks for AI acceptance in healthcare. Physician oversight ensured safety, with 95% of conversations rated as "good" or "excellent" by general practitioners experienced in operating a medical advice chat service. Our findings demonstrate that carefully implemented AI medical assistants can enhance patient experience while maintaining safety standards through physician supervision. This work provides empirical evidence for the feasibility of AI deployment in healthcare communication and insights into the requirements for successful integration into existing healthcare services.
- North America > United States (0.28)
- North America > Canada (0.04)
- Europe > Spain (0.04)
- (3 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Information Technology > Security & Privacy (1.00)
- Health & Medicine > Consumer Health (1.00)
- Health & Medicine > Diagnostic Medicine (0.93)
- Health & Medicine > Health Care Providers & Services (0.93)
Large Language Models for Patient Comments Multi-Label Classification
Sakai, Hajar, Lam, Sarah S., Mikaeili, Mohammadsadegh, Bosire, Joshua, Jovin, Franziska
Patient experience and care quality are crucial for a hospital's sustainability and reputation. The analysis of patient feedback offers valuable insight into patient satisfaction and outcomes. However, the unstructured nature of these comments poses challenges for traditional machine learning methods following a supervised learning paradigm. This is due to the unavailability of labeled data and the nuances these texts encompass. This research explores leveraging Large Language Models (LLMs) in conducting Multi-label Text Classification (MLTC) of inpatient comments shared after a stay in the hospital. GPT-4 Turbo was leveraged to conduct the classification. However, given the sensitive nature of patients' comments, a security layer is introduced before feeding the data to the LLM through a Protected Health Information (PHI) detection framework, which ensures patients' de-identification. Additionally, using the prompt engineering framework, zero-shot learning, in-context learning, and chain-of-thought prompting were experimented with. Results demonstrate that GPT-4 Turbo, whether following a zero-shot or few-shot setting, outperforms traditional methods and Pre-trained Language Models (PLMs) and achieves the highest overall performance with an F1-score of 76.12% and a weighted F1-score of 73.61% followed closely by the few-shot learning results. Subsequently, the results' association with other patient experience structured variables (e.g., rating) was conducted. The study enhances MLTC through the application of LLMs, offering healthcare practitioners an efficient method to gain deeper insights into patient feedback and deliver prompt, appropriate responses.
- North America > United States > New York > Broome County > Binghamton (0.04)
- North America > United States > New Jersey > Camden County > Camden (0.04)
- Asia > Japan > Honshū > Chūgoku > Hiroshima Prefecture > Hiroshima (0.04)
- Asia > China > Hubei Province > Wuhan (0.04)
The robo-dentist will see you now: AI bot operates on a live human without supervision for the first time - and it's 8 times faster than a normal specialist
For many people, sitting back in the dentist's chair can already be a terrifying experience. But now a trip to the dentist could get a whole lot scarier as an AI-powered robot completes its first unsupervised procedure on a live human. The robot, developed by US-based company Perspective, successfully carried out a crown replacement in just 15 minutes - eight times faster than a human specialist. To carry out the procedure, the patient's mouth was first mapped with a 3D scanner before an AI planned and carried out the operation autonomously. Dr Chris Ciriello, CEO and founder of Perceptive, says: 'This medical breakthrough enhances precision and efficiency of dental procedures, and democratizes access to better dental care, for improved patient experience and clinical outcomes.'
- North America > United States (0.50)
- Europe > United Kingdom > England (0.05)
It's Difficult to be Neutral -- Human and LLM-based Sentiment Annotation of Patient Comments
Mæhlum, Petter, Samuel, David, Norman, Rebecka Maria, Jelin, Elma, Bjertnæs, Øyvind Andresen, Øvrelid, Lilja, Velldal, Erik
Sentiment analysis is an important tool for aggregating patient voices, in order to provide targeted improvements in healthcare services. A prerequisite for this is the availability of in-domain data annotated for sentiment. This article documents an effort to add sentiment annotations to free-text comments in patient surveys collected by the Norwegian Institute of Public Health (NIPH). However, annotation can be a time-consuming and resource-intensive process, particularly when it requires domain expertise. We therefore also evaluate a possible alternative to human annotation, using large language models (LLMs) as annotators. We perform an extensive evaluation of the approach for two openly available pretrained LLMs for Norwegian, experimenting with different configurations of prompts and in-context learning, comparing their performance to human annotators. We find that even for zero-shot runs, models perform well above the baseline for binary sentiment, but still cannot compete with human annotators on the full dataset.
- Europe > Faroe Islands > Streymoy > Tórshavn (0.04)
- North America > United States > Washington > King County > Seattle (0.04)
- North America > United States > Oregon > Multnomah County > Portland (0.04)
- (9 more...)
- Questionnaire & Opinion Survey (0.66)
- Research Report (0.64)
- Overview (0.46)
- Health & Medicine > Consumer Health (0.48)
- Health & Medicine > Therapeutic Area (0.46)
Probabilistic emotion and sentiment modelling of patient-reported experiences
Murray, Curtis, Mitchell, Lewis, Tuke, Jonathan, Mackay, Mark
This study introduces a novel methodology for modelling patient emotions from online patient experience narratives. We employed metadata network topic modelling to analyse patient-reported experiences from Care Opinion, revealing key emotional themes linked to patient-caregiver interactions and clinical outcomes. We develop a probabilistic, context-specific emotion recommender system capable of predicting both multilabel emotions and binary sentiments using a naive Bayes classifier using contextually meaningful topics as predictors. The superior performance of our predicted emotions under this model compared to baseline models was assessed using the information retrieval metrics nDCG and Q-measure, and our predicted sentiments achieved an F1 score of 0.921, significantly outperforming standard sentiment lexicons. This method offers a transparent, cost-effective way to understand patient feedback, enhancing traditional collection methods and informing individualised patient care. Our findings are accessible via an R package and interactive dashboard, providing valuable tools for healthcare researchers and practitioners.
- Oceania > Australia > Western Australia (0.04)
- Oceania > Australia > Queensland (0.04)
- North America > United States > New York (0.04)
- (4 more...)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology > Mental Health (0.94)
- Health & Medicine > Therapeutic Area > Oncology (0.93)
- Health & Medicine > Consumer Health (0.92)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Discourse & Dialogue (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Directed Networks > Bayesian Learning (1.00)
Machine Learning Applications In Healthcare: The State Of Knowledge and Future Directions
Roy, Mrinmoy, Minar, Sarwar J., Dhar, Porarthi, Faruq, A T M Omor
Detection of easily missed hidden patterns with fast processing power makes machine learning (ML) indispensable to today s healthcare system. Though many ML applications have already been discovered and many are still under investigation, only a few have been adopted by current healthcare systems. As a result, there exists an enormous opportunity in healthcare system for ML but distributed information, scarcity of properly arranged and easily explainable documentation in related sector are major impede which are making ML applications difficult to healthcare professionals. This study aimed to gather ML applications in different areas of healthcare concisely and more effectively so that necessary information can be accessed immediately with relevant references. We divided our study into five major groups: community level work, risk management/ preventive care, healthcare operation management, remote care, and early detection. Dividing these groups into subgroups, we provided relevant references with description in tabular form for quick access. Our objective is to inform people about ML applicability in healthcare industry, reduce the knowledge gap of clinicians about the ML applications and motivate healthcare professionals towards more machine learning based healthcare system.
- Europe > Switzerland > Basel-City > Basel (0.04)
- South America > Uruguay > Maldonado > Maldonado (0.04)
- South America > Uruguay > Artigas > Artigas (0.04)
- (11 more...)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.93)
MasonNLP+ at SemEval-2023 Task 8: Extracting Medical Questions, Experiences and Claims from Social Media using Knowledge-Augmented Pre-trained Language Models
Ramachandran, Giridhar Kaushik, Gangavarapu, Haritha, Lybarger, Kevin, Uzuner, Ozlem
In online forums like Reddit, users share their experiences with medical conditions and treatments, including making claims, asking questions, and discussing the effects of treatments on their health. Building systems to understand this information can effectively monitor the spread of misinformation and verify user claims. The Task-8 of the 2023 International Workshop on Semantic Evaluation focused on medical applications, specifically extracting patient experience- and medical condition-related entities from user posts on social media. The Reddit Health Online Talk (RedHot) corpus contains posts from medical condition-related subreddits with annotations characterizing the patient experience and medical conditions. In Subtask-1, patient experience is characterized by personal experience, questions, and claims. In Subtask-2, medical conditions are characterized by population, intervention, and outcome. For the automatic extraction of patient experiences and medical condition information, as a part of the challenge, we proposed language-model-based extraction systems that ranked $3^{rd}$ on both subtasks' leaderboards. In this work, we describe our approach and, in addition, explore the automatic extraction of this information using domain-specific language models and the inclusion of external knowledge.
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Oceania > Australia > Victoria > Melbourne (0.04)
- Oceania > Australia > New South Wales > Sydney (0.04)
- (8 more...)
- Research Report > Experimental Study (0.68)
- Research Report > New Finding (0.46)
- Media > News (0.77)
- Health & Medicine > Therapeutic Area > Psychiatry/Psychology (0.68)
ChatGPT and health care: Could the AI chatbot change the patient experience?
Thomas Fuchs, the Dean of Artificial Intelligence and Human Health at Mount Sinai in NYC, said AI will be needed to retain the standard of care in the U.S. ChatGPT, the artificial intelligence chatbot that was released by OpenAI in December 2022, is known for its ability to answer questions and provide detailed information in seconds -- all in a clear, conversational way. As its popularity grows, ChatGPT is popping up in virtually every industry, including education, real estate, content creation and even health care. Although the chatbot could potentially change or improve some aspects of the patient experience, experts caution that it has limitations and risks. They say that AI should never be used as a substitute for a physician's care. AI HEALTH CARE PLATFORM PREDICTS DIABETES WITH HIGH ACCURACY BUT'WON'T REPLACE PATIENT CARE' Searching for medical information online is nothing new -- people have been googling their symptoms for years.
- North America > United States > Maryland > Baltimore (0.05)
- North America > United States > California (0.05)
Why Implementing RPA in your Revenue Cycle is Crucial?
Are you tired of spending countless hours on mundane, repetitive tasks that drain your energy and hinder your productivity? Do you wish there was a way to streamline your operations and reduce errors while freeing up your time to focus on growing your business? Look no further than Robotic Process Automation (RPA)! RPA is a technology that uses software robots to automate tedious and time-consuming tasks, freeing up valuable resources and improving overall efficiency. As a Healthcare Revenue Cycle Business Owner, you can benefit from RPA in several ways.
- North America > United States (0.06)
- Asia > Middle East > UAE (0.06)
- Asia > India (0.06)